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ABSTRACT 

Conventional methods used for the presentation of 
pre- and post statistical information generally are deficient in 
economy and compactness and fail to show internal movement from pre- 
to posttest. This technique precludes these shortcomings through the 
presentation of information in a highly visible manner which reveals 
the strata of internal change. It is closely related to the 
contingency- table approach but adds the missing bit of information — 
what happened to the 5 ^'dividual subject’s scoj.'es between the pretest 
and posttest. Furtherinc the procedure will accept only individuals 
for whom there are both ' ' 'Ad post measures. The method may be 
employed with cognitive or Uv>n-cognitive data and is equally 
adaptable to parametric or non-parametric measures. (Author/DLG) 
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Abstract 

Conventional methods used for the presentation cf pre- and post statis- 
tical Information generally are deficient in economy and compactness and fall 
to show Inteimal movement from pre- to posttest. 

The technique presented is intended to preclude these shortcomings through 
the presentation of information in an expedient and highly visible manner which 
reveals the strata of internal change. It is closely related to the contingency- 
table approach but adds the missing bit of information — what happened to the 
individual subject's scores between the pretest and posttest. Furthermore, the 
procedure will accept only individuals concerning whom there are both pre- and 
post measures. 

The method may be employed with cognitive or non-cognitive data and is 
equally adaptable to parametric or non-parametrlc measures. 
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A Movement-Matrix Technique for Determining Strata of 
Pre- and Post Change of Individual Subjects 

This article is Intended to describe a technique for the presentation of 
pre- and post statistical Information which bears the qualities of economy 
and compactness and is generally more Internally informative than conventional 
methods used In the treatment of such information. 

The method possesses a utilitarian characteristic which permits Its employ 
ment with either cognitive or non-cognitive data and is equally adaptable to 
parametric or non-parametric measures. It allows the presentation of infor- 
mation in an expedient and highly visible manner, and It reveals the strata of 
internal change, a capability usually precluded by the limitations of measures 
of central tendency. A brief review of some of these limitations may be useful 
at this point. 

A simple and common technique used to test whether any change has occurred 
between the administration of a pretest measure and a post test measure is to 
compare the arithmetic means computed for the two measures. This minimal infor- 
mation about the two groups of measures is usually augmented by including the 
standard deviation of each group. This comparison can be further dignified 
by calculating the c statistic to test the significance of any difference in 
laeans between the two groups. 

Comparisons based on these statistics can lead to some possibly peculiar 

conclusions. If the two score distributions were approximately normal, the 

1' 

relative positions of the scores for each individual could be reversed between 
the pretest and the posttest. The highest scoring Individual on the pretest 
could have the lowest score on the posttest, the second highest scorer on the 
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pretest could have the second lowest score on the posttest, and so on. In 
the absence of any correlation measure between the pre- and posttest scores, 
the three aforementioned statistics would report that there was no difference 
between the groups. 

Another approach to compa ring pretest results with posttest results Involves 
either the stratification of the data or the use of contingency tables, 'fhese 
procedures may be used with test score intervals or with discrete data such as 
pupil attendance or tardiness to school. They have the advantage of showing 
not only a range of values for the variable under study but also any character- 
istic of the way In which the variables are distributed. 

The contingency- table approach, however, suffers from the same criticism 
leveled at the statistics mentioned above. They describe the numbers of Individ- 
uals scoring af a particular level on both the pretest and the posttest, but they 
do not tell whether they are the same Individuals or different Individuals 
who are occupying that particular pre-post stratum. More succinctly, they do 
not show Internal movement from pre- to posttest. Again, either parametric or 
non-parametrlc tests of significance applied to tables such as these can lead 
to misleading results. 

The movement-matrix procedure described in this article Is closely related 
to the contingency tables but adds the missing bit of Information — what happened 
to the individual subject’s scores between the pretest and the posttest. Further- 
more, it will accept only individuals concerning whom there are both pre- and 
post measures. 

An effort to determine significant differences In the pre- and post academic 
grades of school children who have been exposed to an Intervening variable may 
serve to Illustrate the method. One may wish to learn, for example, whether 
the Ir '.luslon of a reading-improvement course In the program of a random group 
of 140 junior high school students would have a significant effect on their 
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social studies course marks over a period of a school year. 

Assuming that the traditional grades of A, B, C, D, and E are employed 
by their teachers for evaluatory purposes, a 5 x 5 fold working table Is con- 
structed for the dual purpose or recording simultaneously each student's grade 
immediately preceding and following his reading course experience. 

The horizontal cells (columns) from left to right represent the pre-program 
marks In which the cells at the left extremity of the fold are used to record 
the E's and those at the opposite extremity are employed to record the A's. 
Similarly, the vertical cells (rows) from the bottom to top of the fold are 
used to record the post-program marks. It is noted that the pre- and post 
academic grades for each youngster are posted simultaneously on the matrix 
table in horizontal-vertical sequence and are represerted by a single dot 
symbol. 

For example, a child whose mark, both pre- and post, was a "C" would be 
represented by a dot in the very center cell of the fold. Another youngster 
whose pre-program mark was an "E" but whose post-program mark was an "A" would 
be represented by a dot in the upper-left corner cell. Tlius, the posting of 
the pre-post marks of pupils in the upper-left off-diagonal cells indicates 
degrees of Improvement. Conversely, posting in the lower-right off-diagonal 
cells of the fold is indicative of retrogression. The posting in the cells 
which comprise the diagonal from the lower left to the upper right comer 
represent those for whom no mark change had occurred. 

A hypothetical distribution of the pre-post marks of the students cited 
above is depicted in Diagram 1 which comprises a typical tally sheet. The 
geographical location of the dot symbols, as noted above, reveals what has 
happened to each student with regard to his pre and post-program evaluatory 
grades. 
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= 29 .SI, significant at the 



.01 level. 



Numerals in red are to italicized. 
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A tally of the dots In each of the 25 cells Is represented by the numerical 
entries In Diagram 2.^ For purposes of Interpretation the numerals above the 
broken lines are representative of the number of pupils who manifested a pre-post 
improvement of at least t\J 0 marks (for example, a "D" to a "B") » whereas those 
numerals below the broken lines are indicative of numbers of pupils who retro- 
gressed by a similar margin. The diagonal numerals (Italicized) from bottom 
left to upper right depict the numbers of youngsters whose pre- and post grades 
were respectively identical and, therefore, showed no change. 

The data show that eighty-eight (63%) students improved by at least one 

mark on a pre-post basis, and that eleven (8%) students retrogressed by one mark 

or more. The evaluatory grades of forty-one (29%) youths remained at Identical 

pre-post levels. On the basis of a change of two marks or more, it is seen that 

thirty-four (24%) pupils progressed by this extent, and four (3%) pupils showed 

2 

corresponding retrogression. 

A tmlque quality of the movement-matrix technique lies in its capacity to 
reveal the changes which occurred in the pre-post marks (or test scores, self 
concepts, etc.) of each individual in the group under study. It is seen that 
nineteen (14%) students improved their mark from a "C" to a "B", and that twelve 
(9%) youths improved by two grades, having progressed from a "C" to an "A" grade. 
Conversely, it is shown that two youths who had merited a grade of "A" prior to 
the reading- improvement variable retrogressed to marks of "B" and "C" respectively. 
Moreover, ten individuals (center cell) who had been "C" students prior to the 
program were accorded an identical grade at the program's conclusion. 



^For pragmatic implementation, the tally sheet alone may be used for all 
computational procedures. 

^The marginal totals of the pre-program columns and their counterpart post- 
program rows are adaptable to the chi square test of statistical slgnlflcaiice. 

In this instance the differences were significant at the ,01 level. 



The extent of Improvement or retrogression, if any, in the pre- and post 
marks of each student comprising the sample may be ascertained by this technique, 
and It also discloses collective Information regarding the group as a whole or 
portions thereof. Data concerning sub-groupings according to sex, age, I.Q., etc., 
may be similarly depicted. 

In addition to Its employment with discrete data as In the example described, 
the method Is likewise adaptable to usage with scaling measures. Limited only by 
feasible considerations of the numbers of Intervals one wishes to employ for a 
given purpose. It Is believed that the movement-matrix method of determining 
pre- and post changes among Individual subjects, as well as by the composite 
group, will prove useful to those who regard such Information pertinent to their 
goals and purposes. 



